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ABSTRACT 

The  research  focused  on  long-range  dependence,  high  variability  and  non-linear  fdlering 
in  time  series.  Long-range  dependence  occurs  when  the  low  frequencies  have  a  fundamental 
impact  oil  the  dependence  structure  of  the  data.  There  is  high  variability  when  the  data  is 
non-Ganssian  and  takes  large  values  with  high  probability,  for  example  when  it  is  Pareto  or 
has  a  stable  distribution.  The  data  can  also  be  the  output  of  a  non-linear  filter  and  hence 
possess  non-linear  characteristics. 

We  studied  the  behavior  of  symmetric  statistics,  e.g.  U  and  Von  Mises  statistics^  and  the 
asymptotic  behavior  of  quadratic  forms,  when  the  data  has  finite  variance  with  long-range 
dependence.  The  results  are  non-standard.  We  also  focused  on  situations  where  the  data 
has  a  stable  distribution  and  hence  exhibits  high- variability.  We  studied  joint  moments  and 
conditional  moments,  and  linear  regression  problems.  Linear  Fractional  Levy  Motions  are 
important  models  when  the  data  exhibit  both  high  variability  and  long-range  dependence. 
We  found  that  there  are  many  such  models  and  we  investigated  their  asymptotic  dependence 
structure.  We  studied  the  tail  behavior  of  probability  distributions  of  multiple  integrals  with 
respect  to  stable  noise  and  the  sample  paths  behavior  of  related  stochastic  processes.  We 
also  developed  a  technique  for  approximating  both  the  information  structure  and  the  paths 
behavior  of  stochastic  processes. 
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TECHNICAL  DESCRIPTION  OF  RESULTS 


STATISTICAL  METHODOLOGIES  FOR  NON-GAUSSIAN  NOISY  ENVIRONMENTS 


Murad  S.Taqqu 


Principal  investigator 


Air  Force  Office  of  Sponsored  Research  AFOSR-89-0115 


This  is  the  final  Report  on  the  Air  Force  Office  of  Sponsored  Research  grant  AFSOR- 
89-0115  at  Boston  University.  Results  of  the  completed  work  are  summarized  here.  For  ease 
of  exposition  the  subsections  below  may  include  the  description  of  more  than  one  article. 

Syinmetric  statistics  of  long-range  deperident  observation 

Dehling  and  Taqqu  (1988b)  study  the  behavior  of  classical  bivariate  statistics  when  the 
observations  have  long-range  dependence.  They  suppose  that  these  observations  are  the 
output  of  a  non-linear  filter  with  Gaussian  input. 

Applications  include  the  sample  variance,  the  chi-squared  goodness  of  fit  test  and  the 
Cramer-von  Mises  criterion.  The  results  obtained  are  non-standard,  illustrating  the  fact 
that  classical  statistics  can  have  unusual  properties  when  there  is  long-range  dependence. 

Continuous  functions  whose  level  sets  are  orthogonal  to  all  polynomials  of  a 
given  degree 

The  following  result,  obtained  by  Dehling  and  Taqqu  (1988a)  is  used  to  settle  an  open 
problem  on  empirical  processes  of  long-range  dependent  sequences.  The  authors  provide  an 
explicit  construction  of  continuous  functions  whose  level  sets  are  orthogonal  to  all  polyno¬ 
mials  of  a  given  degree. 
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Power  counting  theorems 

For  what  values  of  ao,  01,02  and  03  does  the  integral 

-  ,  i(x+S+z)-l  a„ 

/  3  7  T  \  1=^  +  1  \y  -  21“^ \zrdxdydz 

Jk^\{x  +  y  +  z) 


converge?  The  power  counting  theorem  obtained  by  Terrin  and  Taqqu  (1989a)  gives  the 
answer.  It  provides  convergence  conditions  for  a  class  of  integrals  on  R”  whose  integrands 
are  products  of  functions  bounded  near  zero  by  powers  of  linearly  dependent  affine  functionals 
and  near  infinity  by  different  powers  of  those  functionals.  The  theorem  is  useful  in  studying 
asymptotic  distributions  of  statistics  of  time  series  with  long  range  dependence.  It  is  also 
related  to  Dyson’s  power  counting  theorem  in  mathematical  physics. 

A  Noiiceiitral  limit  theorem  for  quadratic  forms  of  Gaussian  stationary  sequences 

Let  A'o,  A'l,  A'2,  • . .  be  a  mean  zero  stationary  Gaussian  sequence  with  spectral  density 

f{x)  =  \x\~°‘ L\{x),  a  <  1  and  let  {at}^_oo  ^>6  Fourier  coefficients  of  a  function  g{x)  = 

\x\~^ L2{x),  /?  <  1.  Here  Li  and  L2  are  slowly  varying  functions  at  0,  bounded  on  bounded 
intervals.  The  condition  a  <  1  and  (3  <  1  ensures  that  the  Fourier  coefficients  of  /  and  g 
are  well  defined.  (The  Fourier  coefficients  of  /  are  the  covariances  r[k)  =  EXiXi^k}  ^  — 
—  00, . . . ,  +00).  When  a  >  0,  the  stationary  sequence  exliibits  “long-range  dependence.” 

Terrin  and  Taqqu  (1989b)  investigate  the  i ’’i:(  of  the  normahzed  quadratic  form 
j  /-[TVt]-!  [IVtl-l  [Nt]-l[Nt]-l  ^ 

2^r(i)  =  T-{  E  E  <‘i-kXiXu~E  Y,  Y  •‘i-l.XiXt)  (1) 

i  ;=0  Jt=0  7=0  k=Q  J 

for  different  values  of  a  and  (3,  where  dpf  is  a  suitably  chosen  normalization  factor  and  [  ] 
denotes  the  greatest  integer.  They  show  that  converges  (in  £>[0,  Ij)  to  a  new  type  of 

non-Gaussian  self-similar  process  v’hich  can  be  represented  as  a  Wiener-lto  integral  on  R^. 
The  representation  is  given  exphcitely  and  compared  with  that  of  other  known  processes. 
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The  case  of  moving  averages 


The  results  obtained  in  Terrin  and  Taqqu  (1989b)  are  extended  in  Terrin  and  Taqqu 
(1989c)  to  observations 

A'j  =  i  =  0. 1.  ■  •  • 

3  =  — OO 

that  are  moving  averages  of  i.i.d.  random  variables  ^,’s  with  finite  variance.  The  coefficients 
6(j)’s  are  such  that  the  Xj's  exhibit  long-range  dependence.  Moreover,  the  product  XjXk 
in  the  quadratic  form  (1)  is  replaced  by  a  more  general  Appell  polynomial 
of  the  observation,  that  is,  a  polynomial  of  degree  at  most  m  +  n,  which  is  adapted  to  the 
distribution  of  the  Xj’s.  For  example,  ■Pm,  n  is  a  Hermite  polynomial  if  the  Xj’s  are  Gaussian. 
These  polynomials  characterize  outputs  of  non-linear  filters. 

The  asymptotic  behavior  as  iV  — »  oo  of 

:r  £  S  “i-t  Prr.A^'Cj.xt) 

j=l fc=l 

is  tlien  obtained.  When  the  parameters  are  in  a  suitable  range,  the  limit  turns  out  to 
be  essentially  similar  to  the  one  which  arises  when  PTn,n{-^j,^k)  =  —  EXjXk  with 

Gaussian  Xj’s. 

Terrin  and  Taqqu  (1989e)  describe  of  the  state  of  our  present  knowledge  on  the  asymp¬ 
totic  behavior  of  quadratic  forms. 

Convergence  to  a  Gaussian  limit  as  the  normalization  exponent  tends  to  1/2 

Certain  quadratic  forms  with  long-range  dependence,  normalized  by  with  d  >  1/2, 
have  a  non-Gaussian  limit.  Terrin  and  Taqqu  (1989d)  show  that  under  further  normalization, 
as  (/  — >  1/2,  the  limit  becomes  Gaussian.  This  illustrates  the  importance  of  the  exponent  in 
the  normalization. 


A  generalized  Holder  inequality 

Avram  and  Taqqu  (1989)  extend  the  well-known  Holder  inequality  to  functions  of  linearly 
dependent  arguments.  They  show  that  in  many  situations,  one  has 

1/  n  ■  ,^m))dn{xi)  . . .  dfi{xm)  <  n  WfiWpi 

j=l  j=i 

where  /y  are  real- valued  linear  functions,  1  <  pj  <  oo  and  ||  ||p  is  the  Lp{ii)  norm.  This 
inequality  is  useful  in  studying  the  behavior  of  Toeplitz  matrices  and  has  appUcations  to 
maximum  likehhood  estimation. 

Joint  moments  of  stable  random  variables 

Let  A'l,  A'2, . . . ,  A'n  be  jointly  a-stable  random  variables,  0  <  a  <  2,  and  let  pi,p2, . . .  ,Pti 
be  non-negative  numbers.  When  is  . . .  lA'nl^"  <  00? 

If  the  Xj  are  independent  then  ElA'ip^  . . .  jA'nP"  =  £^|A'i|^^  . . .  i?(A"n|^"  <  00  if  and 
only  if  pj  <  a,  j  =  1, . . .  ,n.  If  the  A'y  are  all  equal  (say  Ay  =  A'l,  j  =  l,...,n),  then 
E\Xx  \^X..  (A',,(P"  =  E\Xi  [PI +•••+;-«  <  00  if  and  only  if  pi  d- . . .  -f  pn  <  a. 

Samorodnitsky  and  Taqqu  (1989c)  give  a  necessary  and  sufficient  condition  for 
fJ(A'i(P‘  . . .  |A'n(^"  to  be  finite  in  the  general  case. 


Conditional  moments  and  linear  regression  for  stable  random  variables 


Jointly  a-stable  random  variables  with  index  0  <  a  <  2  have  only  finite  moments  of 
order  less  than  a.  Samorodnitsky  and  Taqqu  (1989b)  show  that  their  conditional  moments 
can  be  higher  than  a.  They  provide  conditions  for  this  to  happen  and  use  the  existence  of 
the  conditional  moments  to  study  the  regression  £?(A"2|Ai  =  1).  They  show  that  if  (A'l,  A2) 
is  a  symmetric  a-stable  random  vector,  then  under  appropriate  conditions,  the  regression  is 
well-defined  even  when  a  <  1  and  is  linear  in  x. 


More  specifically,  let  F  be  the  spectral  measure  of  (A'i,A'^2)  and  let  ^2  denote  the  unit 


circle.  If 


/  EM 

IS2  \si\<' 
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for  some  u  >  0,  then  the  coiiditioual  moment  jE(|A"2|^1Xi  =  x)  is  finite  for  p  up  to  a  + 
with  the  restriction  that  p<a  +  ]  if0<a<l  and  p<2ifl<a<2. 

This  provides  conditions  for  the  existence  of  the  regression  E{X2\X\  =  x).  The  regression 
is  linear  when  it  exists  and  is  given  by 

y.i 

(2) 


IP  ^  1 1''  \  2  ^  ^  ® 

£/(A2|Ai  =  x)  =  .. ..  — X  a. 3. 


JA'illg 

where  [A'2,  A'lja  =  j2'Si'°'”^^r(^s)  is  the  covariation  of  A2  and  A"i  and 

||A'i||“  =  [Ai,Ai]a.  Here  if  si  >  0  and  =  -l5i|“-i  if  si  <  0.  The 

relation  (2)  is  the  natural  extension  of  the  well-known  regression  formula  in  the  Gaussian 
case.  It  reduces  to  that  formula  if  a  is  set  equal  to  2. 

The  results  are  applied  to  different  classes  of  symmetric  a-stable  processes,  e.g.  moving 
averages,  sub-Gaussian,  harmonizable  and  sub-stable  stochastic  processes. 


The  various  linear  fractional  Levy  motions 

Linear  Fractional  Levy  motions  are  a-stable  self-similar  processes  with  stationary  incre¬ 
ments  and  a  “moving  average”  representation.  They  can  exliibit  at  the  same  time  long-range 
dependence  and  high  variability.  Their  representation 

A-(i)  =  +  '’1(1  - 

*/—  00 

involves  two  real  parameters  a  and  6.  (The  random  measure  A/  is  a-stable.)  When  a  =  2, 
the  processes  are  identical  to  the  Gaussian  Fractional  Brownian  motion  for  all  values  of  a 
and  b. 

Samorodnitsky  and  Taqqu  (1989a)  show  that  when  0  <  a  <  2,  then  different  values  of 
the  parameters  a  and  b  yield  different  processes,  in  marked  contrast  with  the  Gaussian  case 
a  =  2.  These  results  hold,  even  if  the  processes  are  non-symmetric. 


The  asymptotic  tlepeudence  of  the  various  linear  fractional  Levy  motions 

Let  {A'(t),  —00  <  t  <  00}  be  the  linear  fractional  Levy  motion,  that  is,  an  a-stable 
H-self-similar  process  with  stationary  increments,  parametrized  by  0  <  a  <  2  and  0  <  H  < 
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I,  H  ^  1/a,  and  possessing  a  moving- average  type  representation.  Let  Y{t)  =  A'(<-|-1)— A’’(t) 
be  the  increment  process.  The  asymptotic  dependence  structure  of  the  stationary  process 
Y{-)  can  be  measured  for  real  and  62  by 

r{t)  :=  ry(^i,^2:0 

=  Eexi>{i{dxY{t)  +  e2Y{0))}  -  Etxp{ieiY{t)}Eexp{ie2Y{Q)}, 
as  |t|  — >  00.  Astrauskas,  Levy  and  Taqqu  (1989)  show  that  r[t)  decays  like  a  power,  i.e. 

r{t)  ~  A\t\'' 

|t|  — »  00,  where  A  =  A{0i,62,X,a,H)  and  «  =  K{a,  H)  <  0.  The  constants  A  and  n  are 
obtained  explicitely.  The  dependence  of  the  exponent  k  on  H  can  be  different  in  different 
regions.  For  example,  if  1  <  a  <  2,  then 

r{t)  ~  if  1  -  l/a(a  -  1)  <  /f  <  1,  ff  ^  1/a 

but 

r{t)  ~  if  0  <  7/  <  1  -  l/a(a  -  1). 

The  behavior  of  lim|j|_5,o  r{t)  is  also  studied  for  the  stationary  increments  of  Log-fractional 
Levy  motion,  an  a-stable  1/a-self-similar  process  defined  for  1  <  a  <  2. 

Association 

Random  variables  A'l , . . . ,  A'n  are  said  to  be  associated  if  for  any  functions  /,  g  :  R” 
R,  nondecreasing  in  each  argument,  one  has 

Cov(/(A'i, . . . ,  Xn),g{Xi,. . . ,  A'n))  >  0 

whenever  the  covariance  exists,  Lee,  Rachev  and  Samorodnitsky  (1989)  give  a  necessary 
and  sufficient  condition  for  a-stable  random  variables  A'i,...,A'n  with  0  <  a  <  2  to  be 
associated.  The  condition  can  be  expressed  in  terms  of  their  spectral  measure  F  as  follows. 
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Let  Sn  denote  the  unit  sphere  of  R"  and  let 

S~  =  {(si, . . . ,  5n)  €  5,1  :  for  some  t,i,  €  {1,  •  •  •  ,ti},  >  0  and  Sj  <  0}. 

The  a-stable  random  variables  A'l, . . . ,  A'n  are  associated  if  and  only  if  F  gives  no  mass  to 

Multiple  stable  integrals 

Mucli  progress  has  been  achieved  in  constructing  multiple  stable  integrals 

In(f)  =  /  {{xi,...,Xn)M{dxi)...M{dXn)  (3) 

JR'' 

and  in  deriving  their  properties.  Such  integrals  represent  the  output  of  a  n-order  filter 
(characterized  by  f)  with  stable  noise  input. 

Consider  a  symnictr'c  a-stable,  0  <  a  <  2,  random  measure  M  with  finite  control 
measure  on  the  real  line.  Let  f  be  a  Banach-valued  deterministic  function  defined  on  R’', 
symmetric  in  its  arguments  and  vanishing  on  the  diagonals.  Samurodnitsky  and  Taqqu 
(1989a)  provide  a  construction  of  the  product  measure 

M^^\dxi, . . . ,  dxn)  =  n\M{dx\) . . .  M{dxn) 

and  of  the  multiple  stochastic  integral  Irt(f)  using  a  multiple  LePage-type  series  representa¬ 
tion. 

The  assumption  that  f  belongs  to  a  Banach  space  allows  for  many  types  of  vector  valued 
functions  f.  If  the  Banach  space  is  of  the  Rademacher-type  p  >  a  and  if  ||f||  satisfies  an 
integrability  condition,  then  the  tail  probabihty  of  ||I„(f)||  is  given  by 

P(IH„(f)||>A)~C„.„(f)A-»(liiA)”-‘ 

as  A  — >  oo.  This  last  result  is  estabhshed  in  Samorodnitsky  and  Taqqu  (1989b)  and  is  very 
useful  because  little  is  known  about  the  distribution  properties  of  the  midtiple  integral.  In 
the  case  n  =  2  and  5  =  the  real  line,  the  integrability  condition  reduces  to  the  known 
necessary  and  sufficient  condition  for  the  existence  of  the  integral. 
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Sample  path  properties  of  stochastic  processes  represented  as  multiple  stable 
integrals 

The  paper  Rosiiiski,  Samorodnitsky  and  Taqqu  (1989)  studies  the  sample  path  properties 
of  stochastic  processes  represented  by  multiple  symmetric  a-stable  integrals  as  in  (3).  It 
relates  the  “smoothness”  of  the  sample  paths  to  the  “smoothness”  of  the  (non-random) 
integrand.  It  also  contains  many  apphcations,  including  zero-one  laws  and  the  tail  behavior 
of  the  distribution  of  suprema. 

Approximating  both  the  information  structure  and  the  paths  of  stochastic  pro¬ 
cesses 

Willinger  and  Taqqu  (1988)  describe  a  method  for  approximating  continuous- time  sto¬ 
chastic  processes  with  discrete  time  and  discrete  state  space  models  which  possess  the  same 
“structural”  properties  as  the  original  continuous-time  model.  With  the  help  of  the  approx¬ 
imation,  one  can  explain  and  study  the  structural  properties  of  the  continuous-time  models 
(e.g.  “completeness”  or  “martingale  representation  property”)  by  using  the  corresponding 
simpler  and  well- understood  properties  of  models  that  involve  only  finitely  many  time  points 
and  that  can  take  only  a  finite  number  of  different  values. 

One  essential  feature  of  the  approximation  scheme  is  that  convergence  is  understood  in  a 
strong  sense,  not  only  for  the  approximating  discrete  processes  (where  pathwise  convergence 
is  required)  but  also  for  their  corresponding  information-structures  (filtrations)  for  which  a 
natural  convergence  concept  is  introduced.  This  strong  double-edged  form  of  convergence  is 
responsible  for  the  desirable  “structure-preserving”  property  of  the  approximation  scheme. 
The  approach  is  illustrated  with  various  examples  of  well-known  continuous  securities  market 
models  such  as  the  Black-Scholes  model. 
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